MatFormer architecture

Matryoshka Transformer. Matryoshka Representation Learning 개념을 Transformer architecture 전체에 적용하는 방식.

Papers

• MatFormer: Nested Transformer for Elastic Inference

Models

• Gemma 3n